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ABSTRACT 



Methods and apparatus for dynamically compiling byte 
codes associated with methods during idle periods in the 
execution of a computer program are disclosed. The 
described methods are particularly suitable for use in com- 
puter systems that are arranged to execute both interpreted 
and compiled byte codes. In some embodiments, methods to 
be dynamically compiled are referenced in one or more lists. 
The lists may be prioritized to facilitate the compilation of 
the highest priority methods first. In one embodiment, a pair 
of compilation lists are provided with a first one of the 
compilation lists being created prior to processing the com- 
puter program while the other is created during the process- 
ing of the computer program. 

28 Claims, 6 Drawing Sheets 
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METHOD AND APPARATUS FOR 
PERFORMING BYTE-CODE OPTIMIZATION 
DURING PAUSES 

CROSS REFERENCE TO RELATED 
APPLICAnONS 

This application is related to U.S. patent application Ser. 
No. 08/944,332 (Atty. Docket No. SUN1P146/P2296), 
entitled "Inline Database for Receiver Types in Object- 
Oriented Systems," U.S. patent application Ser. No. 08/944, 
335 (Atty. Docket No. SUN1P150/P2300), entitled "Mixed 
Execution Slack and Exception Handling," U.S. patent 
application Ser. No. 08/944,326 (Atty: Docket No, 
SUN1P152/P2302), entitled "Method and Apparatus for 
Implementing Multiple Return Sites," U.S. patent applica- 
tion Ser. No. 08/944,331 (Atty. Docket No. SUN1P156/ 
P2306), entitled "Site Specific Message Dispatch in Object- 
Oriented Systems," U.S. patent application Ser. No, 08/944, 
334 (Atty. Docket No. SUN1P168/P2840), entitled "Method 
and Apparatus for Dynamically Optimizing Byte-Coded 
Programs," U.S. patent application Ser. No. 08/944,330 
(Atty. Docket No. SUN1P175/P2841), entitled "Method and 
Apparatus for Dynamically Optimizing Compiled 
Activations," all filed concurrently herewith, U.S. patent 
application Ser. No. 08/884,856 (Atty. Docket No. 
SUN1P144/P2260), entitled "Interpreting Functions Utiliz- 
ing a Hybrid of Virtual and Native Machine Instructions," 
filed Jun. 30, 1997, and U.S. patent application Ser. No. 
08/885,008 (Atty. Docket No. SUN1P151/P2301), entitled 
"Interpreter Generation and Implementation Utilizing Inter- 
preter States and Register Caching," filed Jun. 30, 1997, 
which are all incorporated herein by reference for all pur- 
posesin their entirety. 

BACKGROUND OF THE INVENTION 

1. Field of Invention 

The present invention relates generally to methods and 
apparatus for optimizing the execution of software appUca- 
tions. More particularly, the present invention relates to 
methods and apparatus for performing compilations or other 
activities during pauses in the overall execution of a com- 
puter program to optimize the use of computer system 
resources. 

2, Description of Relevant Art 

Computer systems are often linked across a network, e.g., 
local area networks, intranets and internets, of computer 
systems such that they may share resources such as software 
applications. In general, software applications, or computer 
programs, may be delivered in different fonmats to different 
computer systems, due to the fact that each computer system 
requires software applications to be in a specific format. 
Alternatively, the computer programs may be defivered to a 
computer system in a machine -independent form, i.e., as 
byte codes, in order to enable one form of a computer 
program to be utilized by many different computer systems. 

When computer programs are delivered in a machine- 
independent form, the programs may be interpreted directly, 
or the programs may be translated into machine-dependent 
code, i.e., "machine code." Programs which are interpreted 
directly occupy less space in a computer system than pro- 
grams which are translated into machine code. However, 
programs which are interpreted directly have slower execu- 
tion speeds than programs which are translated into machine 
code, in most cases. As such, the determination of whether 
or not to interpret a computer program directly, in lieu of 
translating the computer program into machine code, is 
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often based on the relative importance of space in relation to 
execution speed. 

One approach to compilation is to compile methods 
within a program that is actively executing when Ihey are 

5 first called for execution. This approach is frequently 
referred to as either dynamic or "runtime" compilation. One 
problem with dynamic compilation is that the compilation 
overhead associated with the program may become exces- 
sive. That is, when a relatively large number of methods 

30 niust be compiled at about the same time, the overhead 
associated with the compilation of the program may be al a 
level that adversely affects the overall execution of the 
program. In general, an overuse of system resources for 
compilation may lead to a less efl&cient, slower execution of 

15 the program. In addition, the time consumed by a compiler 
which is compiling methods during active program execu- 
tion may introduce user-visible pauses into the execution of 
the program. By way of example, when a user inputs a 
command into the program while the compilation overhead 

20 of the program is high, there may be a delay in the response 
to the user input. Such delays in response may be annoying 
to a user. Therefore, mechanisms that improve the apparent 
efficiency of dynamic compilation of methods in a computer 
program would be desirable. 

25 SUMMARY OF THE INVENTION 

To achieve the foregoing and other objects of the 
invention, methods and apparatus for dynamically compil- 
ing methods during idle periods in the execution of a 
computer program are disclosed. The described methods are 
particularly suitable for use in computer systems that are 
arranged to execute both interpreted and compiled byte 
codes. According to one aspect of the present invention, an 
idle or low overhead period in the processing of a computer 

35 program is identified. One or more methods that have been 
identified for compilation are then dynamically compiled 
during the identified idle period. In some embodiments, 
methods to be dynamicaUy compiled are referenced in one 
or more lists. The lists may be prioritized to facilitate the 

^ compilation of the highest priority methods first. In one 
embodiment, a pair of compilation lists are provided with a 
first one of the compilation lists being a database list created 
prior to processing the computer program while the other 
being an execution list created during the processing of the 
computer program. 

In one embodiment, if an interrupt is received during the 
compilation of a method, the compilation is allowed to 
continue for a predetermined period of time. If the compi- 
lation is not completed during the predetermined period of 

50 time, then the compilation is aborted. 

In some embodiments, a determination is made regarding 
whether a method identified for compilation has previously 
been compiled after a period of low activity has been 
identified. When it is determined that the method has not 

55 been previously compiled, the compilation is initialized. If 
the first method has already been compiled, a second method 
is selected during the period of low activity, and the com- 
pilation of the second method is initiated if the second 
method has not been previously compiled. 

60 In other embodiments, a priority value is determined for 
each of a plurality of methods associated with the computer 
program. The highest priority methods are then executed 
first. In one such embodiment, the priority value for each 
method is determined by processing an invocation counter 

65 associated for each method during the period of low activity. 
According to still another aspect of the present invention, 
a computer system for dynamically compiling byte-coded 
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methods during a period of low activity in the processing of particular method. In the present invention, method and an 

a computer program includes a mechanism for identifying a apparatus are described for delaying the dynamic compila- 

period of low activity. The system further includes a mecha- tion of methods in a computer program when compilation 

nism for identifying a method for compilation during the overhead is relatively high. More specifically, when it is 

period of low activity. A compiler is arranged to initialize a 5 determined that compilation overhead is too high, the 

compilation of the identified method during the period of dynamiccompilationof at least some of the methods may be 

low activity. In one embodiment, the system also includes an ^^^^^V^d until there are periods of relatively lower activity m 

interrupt processor which is arranged to handle interrupt processmg of the program, 

signals received during the compilation of the identified ^ ^y delaying the dynainic compilation of at least some 

method, and an aborting mechanism which aborts the com- lO byte-coded methods which are slated for conipUation, com- 

pUation of the method when necessary. P^^^^ ^^^^^ ""^7 ^ efficiently utilized. While a 

^ . . computer program is essentially mactive dunng processing. 

These and other advantages of the present mvenlion wiU ^ ^^^^ computer program is idle while awaiting input 

become apparent upon reading the following detailed f^^^ ^ ^^^^ t^e overaU resource utilization overhead asso- 

descriptions and studying the various figures of the draw- ^.j^ted with the execution of the program is generally rela- 

"^S^- tively low. During such periods of low activity, available 

system resources may be used to perform compilations of 
methods which have previously been identified as being 

The invention may best be understood by reference to the methods which are to be compiled. Performing compilations 

following description taken in conjunction with the accom- while the computation overhead of the computer program is 

panying drawings in which: low allows for the efficient usage of overall system resources 

no. 1 is a block diagram representation of a computer ^^^^ typically, does not cause delays which are noticeable to 

system which dynamically compiles code in accordance ^ 

with an embodiment of the present invention. With initial reference to FIG. 1, a computer system which 

HG. 2 is a process flow diagram which Ulustrates the 25 ^y^^ be dynamically compiled will be 
steps associated with executing a program which includes described in accordance with an embodiment of the present 
the capability of compiling code during pauses in accor- invention. Byte codes 144 are provided as input to a corn- 
dance with an embodiment of the present invention. P"^^^ l^"™ ^^-^ime. Byte codes 144, which may 

.^.^ , . n J. L- 1. -11 L generally be organized as a computer program, are typically 

HG. 3 IS a process flow diagram which illustrates the arranged in parseable segments such as methods, or routines, 

steps associated with performing compilations on methods, 30 embodiment, byte codes 144 may be provided by a 

I.e., step 216 of FIG. 2, in accordance with an embodiment ^ompile-time environment within a virtual machine to a 

ot the present mvention. run-time environment, e.g., computer system 146, within the 

FIG. 4 is a process flow diagram which illustrates the same virtual machine. One suitable virtual machine on 

steps associated with identifying the highest priority ^^ich the present invention may be implemented will be 

method, i.e., step 302 of FIG. 3, in accordance with an discussed below in more detail with respect to FIG. 6. 

embodiment of the present invention. y^^^^ ^^^^ ^^^^ 144 provided to computer system 

FIG. 5 illustrates a typical, general purpose computer 146, byte codes 144 may be processed with an interpreter 

system suitable for implementing the present invention. 148. Alternatively, byte codes 144 may be compiled by a 

FIG. 6 is a diagrammatic representation of a virtual 40 compiler 150 to produce compiled byte codes 152. It should 
machine which is suitable for implementing the present be appreciated that byte codes 144 may generally be input- 
invention, ted to both interpreter 148 and compiler 150 for processing, 

substantially simultaneously. 

DETAILED DESCRIPTION OF THE gach time a method is invoked, if the method is not 

EMBODIMENTS compiled, byte codes 144 associated with the method are 

As described above, the dynamic compilation of methods interpreted using interpreter 148. In one embodiment, a 

associated with a byte-coded program while the program is measure of how many times a method is interpreted is 

actively executing may cause the program to execute inef- maintained. Such measures may include a counter, e.g., an 

ficiently. This inefficiency may be a result of an excessive invocation counter, which is included in each interpreted 

use of available computer system resources by the compiler, 50 method, and is incremented each time the method is 

or compilation overhead. The time consumed by a compiler interpreted, as described in co-pending U.S. patent applica- 

that is dynamically compiling methods during active pro- lion Ser. No.: 08/944,334 (Atty. Docket No. SUN1P168/ 

gram execution may introduce delays into the execution of P2840), which is incorporated herein by reference in its 

the program. When such delays are perceptible to a user, the entirety. 

delays may be considered to be unacceptable, especially 55 When the number of times a method is inteipreted 

when the length of a delay is relatively long, e.g., more than exceeds a threshold, i.e., a limiting value, the method may 

approximately 200 milliseconds. be compiled using compiler 150. Repeatedly interpreting a 

One approach to improving the performance of such method, which is included in frequently executed code 158, 

programs is to permit the mixing of both interpreted and naay be inefficient, as interpreted byte code 154 generally 

dynamically compiled byte codes. By way of example, an 60 executes slower, or less efficiently, than compiled code, 

improved computer system that is arranged to execute both Compiling frequently executed code 158 generally may 

interpreted byte codes and dynamically compiled byte codes allow methods embodied in frequently executed code 158 to 

is described in commonly assigned, co-pending U.S. patent be executed more efficiently, as time-savings gained by 

application Ser. No.: 08/884,856 (Atty. Docket No. compiling the method is likely to compensate for the com- 

SUN1P144/P2260), filed Jun. 30, 1997, which is incorpo- 65 pilation overhead associated with the compilation process, 

rated herein by reference. Within such a system, decisions During run-time, the compilation overhead associated 

must still be made as to when it is efficient to compile a with compiling byte codes 144 using compiler 150 is 
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monitored to ensure that the compilation overhead does not determine when the CPU usage falls below a certain usage 

exceed a typically predetermined maximum acceptable threshold. The usage threshold, i.e., a "low activity 

level. The compilation overhead is often expressed in terms threshold," may be widely varied. By way of example, the 

of the percentage of processor time required for compilation usage threshold may be set such that when substantially only 

as opposed to execution. The predetermined maximum 5 activities with low overhead, such as setting a cursor to 

overhead level may be widely varied depending on the needs periodically blink, are running, the program is considered to 

and characteristics of a particular system. By way of be idle. In one embodiment, when CPU usage during the 

example, for a virtual machine intended to provide high processing of the program falls below a usage threshold 

execution performance, the predetermined maximum level which is approximately 20 percent of the overall system 

may be within the range of approximately 10 percent to resources, then the overall processing of the program is 

approximately 30 percent usage of the overall system considered to be in a period of low activity. At such times, 

resources. When the overhead associated with the compila- at least approximately 80 percent of the system resources 

tion of byte codes 144 exceeds the predetermined maximum may be available for use. 

level, then methods which would be compiled if the com- Monitoring the status of threads may involve studying a 

pilation overhead were lower may be placed m an execution ^^^^^^ scheduler, as will be appreciated by those skilled in 

list, or queue. This execution hst is essentially a waiting list ^^^^ ^^^^^ ^^^^^^^^ -^^-^^^^^ ^^^^ ^^^^^^ 

of methods which may be Processed when the cornpilation substantially none of the threads are in a 

overhead IS lower, i.e., methods in the execution list may be ui » * . \u • r • * .u 

compiled when the compilation overhead is lower. "^^'^^^l^ sUte then the unplic^^^^ 

Specifically, the execution Ust may be processed at times consuming CPU Ume. CPU time will generally not be 

when both the compilation overhead, as well as the overall 20 consumed until a signal arnves at which point a thread may 

computation overhead associated with computer system become unblocked. When CPU time is not being consumed, 

146 are at a low level. ^ben the program is generally in an idle period. 

When byte codes are to be compiled during otherwise idle If it is determined in step 212 that the execution of the 

periods in the overall execution of a program, e.g., during program is not in an idle period, then process flow returns to 

idle periods which occur throughout the processing of byte 25 step 210 where the program continues to execute. If, instead, 

codes, the program may be monitored to determine when it is determined in step 212 that there is an idle period, a 

pauses occur. Referring next to FIG. 2, a process of execut- determination is made in step 214 regarding whether there 

ing a program, or an application, which includes the capa- are any pending tasks, as for example compilations. That is, 

bility of compiling code during pauses will be described in a determination is made regarding whether there are any 

accordance with an embodiment of the present invention, ^ tasks which are slated to occur during idle periods. The tasks 

The execution of a program begins at step 210, and in step may generally include a wide variety of tasks, as for 

212, a determination is made regarding whether the execu- example compilations and garbage collection. Such tasks 

tion of the program has reached an idle period. may be prioritized in terms of their relative importance 

An idle period is generally a pause, e.g., a think pause, in within a system. In the described embodiment, the tasks will 
the processing of the program during which the program is 35 be described in terms of pending compilations, 
essentially inactive. The program may be awaiting an action Pending compilations may generally be obtained from 
such as a timer signal from the associated operating system, two sources, a database list and an execution list, which are 
or the program may be awaiting a user input, prior to lists of "candidate" methods for compilation. One arrange- 
actively continuing execution. In general, a think pause ment for creating a database list may involve a system which 
occurs while the program is awaiting an action from a user. ^ monitors compiled methods. An example of such an 
It should be appreciated that the length of an idle period may arrangement for creating a database list when a database is 
vary widely. By way of example, the length of an idle period inlined, is described in co-pending U.S. patent application 
may vary from very few milliseconds to approximately half Ser. No.: 08/944,332, which is incorporated herein by ref- 
a second. When an idle period occurs because a program is erence in its entirety. In such a system, the database list is 
awaiting input from a user, the idle period may generally be 45 essentially a "working set," or a "candidate set," of methods 
much longer, as for example on the order of a number of which were compiled during a previous execution of the 
seconds, minutes, days or more. program, and are considered as methods that are likely to be 

In general, a threshold value is used to recognize a compiled in a subsequent execution of the program. One 

"useful" pause. For example, if the actual pause has lasted system which is capable of creating a database Ust. Other 

for a predetermined number of milhseconds, then the system 50 mechanisms may be used to create or add to a database list 

may recognize the pause as a useful pause which is likely to as well. It should be appreciated that in some embodiments, 

continue for a whole longer. When the pause is likely to the database list may include other tasks such as the per- 

continue, then compilations may be allowed to continue in formance of garbage collection. 

order to exploit the pause. As such, the determination in step Aii execution list, as mentioned above, is a queue of 
212 regarding whether the execution of the program has 55 methods, or a candidate set of methods, which is created 
reached an idle period involves determining whether a during the current execution of the program. The execution 
period of low activity has reached a threshold value, e.g., list may contain, or identify, methods which were sup- 
approximately 100 milliseconds or approximately half a pressed from compilation due to the fact that the compilation 
second. overhead, as described in co-pending U.S. patent application 
In general, the occurrence of an idle period, or period of eo Ser. No.: 08/944^34, was previously considered to be too 
relatively low activity, may be identified by monitoring the high to allow the methods to be compiled. The execution list 
usage of the central processing unit (CPU) associated with may also identify methods which were periodically added to 
the execution of the program. Alternatively, the existence of the hst by a separate sweeper process which studies the 
an idle period may be determined by monitoring the status invocation counters, i.e., counters which track the number of 
of threads associated with the overall computer system. 65 times a method has been interpreted, associated with inter- 
When CPU usage is monitored to identify periods of preted methods. In general, the invocation counter for a 
relative inactivity, CPU usage is essentially monitored to method is incremented each time the method is invoked. The 
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sweeper may periodically study invocation counters to previously compiled, then in step 306, the compilation of the 

determine if invocation counters of methods which have not highest priority method begins. That is, the compilation of 

been recently invoked are at a level which is currently the highest priority method is initialized, 

considered to deem the method as appropriate for compila- During the compilation of the highest priority method, 

tion. Since the threshold, e.g., the number of invocations of 5 interrupts may be received. In general, interrupts may 

a method which must generally be reached in order for the include, but are not limited to, timer signals and user inputs, 

method to be considered for compilation, may vary during e.g., keyboard inputs. It is determined in step 308 whether an 

program execution, methods with invocation counters that interrupt has been received. As will be appreciated by those 

are over a current threshold may be added to the execution skilled in the art, when an interrupt is received, the compi- 

list by the sweeper. Other mechanisms may be used to create lation of the highest priority method may automatically 

or add to the execution list as well. In some embodiments, cease in order for the intermpt to be processed as necessary, 

the execution list may be associated with a general work list If an interrupt has been received, then the compilation of 

which includes pending compilations in addition to other the highest priority method is allowed to continue for a 

pending tasks, e.g., garbage collection. predetermined period of lime in step 314. The predetermined 

When it is determined through studying the execution list ^5 period of time is, in one embodiment, essentially a "time to 

and the database list in step 214 that there are no pending live" for a compilation after a signal has been received thai 

tasks, then process flow returns to step 210 in which the will set at least one thread in a run-able state. By allowing 

program continues to execute. When, on the other hand, it is the compilation to continue briefly after an interrupt is 

determined that there are pending compilations, then in step received, the compilation is given a chance to be completed, 

216, the tasks, e.g., compilations, are performed. The steps 20 ^ ^^^^ compilation is close to completion, 

associated with performing the pending compilations will be Although the predetermined period of time may be widely 

described below with reference to FIG. 3. After pending varied, the predetermined period of time is generally a 

compilations are performed, process flow returns to step 210 number of miUiseconds, e.g., "X milliseconds." Shorter 

in which the program continues to execute. periods of time in the range of approximately 10 millisec- 

As previously mentioned, in the described embodiment, a 25 ^^^^ approximately 200 milliseconds are preferred, since 

method is compiled when it is anticipated that compiling the it has been observed that delays of time of greater than 

method and invoking the compiled method is likely to be approximately 200 milliseconds in response to user input are 

more eflScient than interpreting the method. Such compila- perceptible and, hence, often annoying to a user. The period 

tions may be delayed until there are idle periods during the of time may be varied based on the source of the signal or 

execution of the overall program, in order to avoid excessive 30 the priority of the threads in a run-able state, with shorter 

compilation overhead. FIG. 3 is a process flow diagram periods being used for higher-priority signals or threads, 

which illustrates the steps associated with performing After the compilation is allowed to continue for the 

delayed compilations on methods, i.e., step 216 of FIG. 2, in predetermined period of time in step 314, a determination is 

accordance with an embodiment of the present invention. made in step 316 regarding whether the compilation has 

The process of performing compilations begins at step 302 35 been successfully completed during the predetermined 

where the candidate method with the highest priority is period of time. If the compilation has been completed, then 

identified. In one embodiment, the highest priority method process flow moves to step 210 of FIG. 2, where the overall 

may be the method with the highest number of invocation execution of the program continues. It should be appreciated 

counts in, or identified by, the execution list. Alternatively, that once the compilation is completed, the newly compiled 

the highest priority method may be the method with the 40 method will also be removed from either the execution list 

shortest anticipated compilation time on the execution list. or the database list, depending upon which list the method 

The identification of the highest priority method will be was obtained firom. 

discussed in more detail below with reference to FIG. 4. When the compilation is not completed during the pre- 

After the highest priority method is identified in step 302, determined period of time, then process flow moves from 

a determination is made in step 304 regarding whether the 45 step 316 to step 318 in which the compilation is aborted. The 

highest priority method has already been compiled. The compilation is not allowed to be completed due to the fact 

highest priority method may already be compiled for a that allowing the compilation to be completed may result in 

variety of different reasons. By way of example, after the a significant delay in the execution of the overall program or, 

method is placed in the execution list, during the course of more specifically, the processing of the interrupt. When the 

overall program execution, the method may be invoked and 50 compilation is aborted, "clean up" occurs, e.g., system 

compiled while compilation overhead is low. As such, the resources used in the attempted compilation are 

method is already compiled, and may not have been relinquished, as wiU be understood by those skilled in the 

removed from the execution list, as repeatedly updating the art. Once the compilation is aborted, process flow moves to 

execution list is expensive. The highest priority method may step 210 of FIG. 2, in which the overall execution of the 

also be previously compiled if the method is obtained firom ss program continues. 

the database list. That is, when the same method appears in Remrning to step 308, in the event that no interrupt has 

both the execution list and the database list, if the method been received during the compilation of the highest priority 

was already compiled using the execution list, for example, method, the compilation continues in step 310. A determi- 

and the database list is not updated due to high costs, then nation is made in step 312 regarding whether the compila- 

the method may already be compiled when it is identified as 60 tion has been completed. If it is determined that the com- 

the highest priority method in the database list. pilation has been completed, the highest priority method 

When the determination in step 304 is that the highest may be removed from the appropriate list, and process flow 

priority method is already compiled, then the method may be returns to step 302 in which a new highest priority method 

removed from the appropriate list, i.e., either the execution is identified. Alternatively, if it is determined in step 312 that 

list or the database list, and process Dow returns to step 302 65 the compilation has not been completed, then the compila- 

where a new highest priority method is identified. If, instead, tion is allowed to continue until either it is completed, or it 

it is determined that the highest priority method has not been is aborted due to the receipt of an interrupt in step 308. 
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In general, the "order" in which methods in an execution 302 of FIG. 3, will be described in accordance with an 

list and a database list are compiled may be determined embodiment of the present invention. The identification of 

based upon a number of different factors. The methods in the method with the highest priority begins at step 402 with 

each list may be assigned priority values relative to other a determination of whether any methods are present in the 
methods in the same list. The priority values may generally 5 execution list associated with the program, 

be assigned at any time during the overall execution of the 1° general, methods in an execution list are considered as 

program, and may further be updated throughout the course having compilation priorities that arc higher than those of 

of program execution. By way of example, the priority methods in a database list. Methods in the execution list are 

values in a list may be computed and updated, i.e., methods that have been identified during the course of 
re-evaluated, each time a method is added to the list. Priority lo program execution as being likely to overcome the assod- 

values may also be re-evaluated at the beginning of each idle compilation overhead by executing more efficiently, 

period to ensure that the priorities of methods in the execu- because the methods are repeatedly invoked. Alternatively, 

tion list and the database list ar^ current at the time methods methods in the database fist are methods which may poten- 

are chosen for compilation. ^^^^^X repeatedly invoked and, hence, compiling the 

T, 1 c ^. J . ii*jt- J ic methods is likely to be beneficial. In other words, the 

Thepnonty value of a method may be calculated based on i5 . . i - . « . . , ^ 

. . ;. cc . ' y ji' ^. * * r •* J * *t_ cxecutiou list reflects the current, or actual, usage of 

any combmation of factors mcludmg, but not limUed to, the . . m . . . ,• . i, « , 

* r *u J *u f *u *V J methods, while the database list essentially reflects long- 
invocation count of the method, the position of the method , r.-.-r^r ..i . 

«u 1* * *u *• * J 1 r*i- *i_ J term usage or methods. Therefore, methods from the execu- 

withm the list, the estimated compilation time of the method, ,. , , . „ . r i . r . i 

and the length of the current idle period during the overall yP"^^"y. compUat.on before methods 
execution ofthe program. Alternatively, in one embodiment. 20 fr""" h« "atabase list, smce compiling the methods in the 

. i f ..J *■ 11 u • J execution list is more likely to lead to a more efficient 

the priority value of a method may essentially be assigned „ ~ ^ ... , 

randomly j ^ ^ overall execution of the program which uses the methods. 

^ , J . . . .... • - If the determination in step 402 is that there are methods 

Hie method which has the highest invocation count in a ^ ^^^^ 4^ 

hsl may have the highest compilation priority as it is ^- ^^^ ^^^j, ^^^^^ioa lis, is selected for compi- 

e^ntiaUy the most frequently mvoked mterpreted method. j^jj^^ ^^^^^ ^^^^^^ ^^^^ ^^^^^.^^ ^ 

ITie position of a method within a list may also affect the .^^^ ^^^^ of identifying the highest priority method is 

pnority value assigned to the method, since the meOiod most i,t^ Alternatively, if the determination in step 402 is 

recently added to the hst is often likely to be needed in the ^^^^^^ 

mimediate future. The method which has the shortest esti- y ^est priority method in the database Ust is selected for 

mated compUation tmie in a list may have the highest ^ompUation. After the method is selected from the database 

compilation priority, smoe the compilation of a method with y^j. then the process of identifying the highest priority 

a shorter estimated compilation tune is generally more likely method is completed 

to be completed during an idle period than the compilation . • /• n . - ^ . . 

of a method with a longer estimated compilation time. In .f'^f*"" "^^^ Sf-^^'^Uy ^ implemented on 

general, the compilationlime of a method may be estimated ''"^ ^"'^'^ '^H f ^^^'^"'^ compilauon 

by the length of the method, e.g.. a relatively short method f "J^^"" '^^^ P*"°t "^^^^^ 

will typically have a relatively short compilation time. °f P^g^*"" '^''l ^<^^V}ff using any suitable 

^ / ^ vu-tual machine, such as the virtual machine described 

The length of the current idle period may also affect the 5^1^^ respect to FIG. 6. FIG. 5 illustrates a typical, 
priority value of a method. For example, if the current idle ^ general purpose computer system suitable for implementing 

period has already been relatively long, then the likelihood ^^e present invention. The computer system 530 includes 

that the Idle penod will last longer is generally increased. ^ny number of processors 532 (also referred to as central 

Long idle periods may often be a result of a user leaving the processing units, or CPUs) that are coupled to memory 

computer on which the overall execution of the program is devices including primary storage devices 534 (typically a 

occurring for a prolonged penod of time. As such, it has .^.j ^^jy ^^^^^^ r^M) and primary storage devices 

been observed that when it is determmed that a current idle 535 (typically a random access memory, or RAM), 

period has already been relatively long, the likehhood that Computer system 530 or, more specifically, CPU 532, 

the Idle period will last even longer is generally reasonably ^^^^ ^ ^ ^^^^^^ ^^^^^ 

high. Therefore, when an idle penod is expected to be eciated by those skilled in the art. One example of a 

relatively long, methods with longer expected compilation ^-^j^^j ^^^^-^^ ^^^^ ^ 53^, 

times may have higher compdation pnorities, smce methods ^^^n\,^^ below with reference to FIG. 6. As is well 

with shorter expected compilation times may typically be j^^^^ ^^^^ ^^^^^^^^ ^^^^ instnictions 

readily compiled dunng subsequent shorter Idle periods. uni-directionally lo the CPU 532, while RAM is used 

As previously mentioned, the prionty value of a method typically to transfer data and instructions in a bi-directional 
may be based on a number of different factors. In other 55 manner. CPU 532 may generally include any number of 

words, a priority function may be used to determine a processors. Both primary storage devices 534, 536 may 

priority value. The form of such a priority function may include any suitable computer-readable media. A secondary 

generally be widely varied. By way of example, a priority storage medium 538, which is typically a mass memory 

function may divide the invocation count for a method by device, is also coupled bi-directionally to CPU 532 and 
the estimated compilation time for the method in order to go provides additional data storage capacity. The mass memory 

obtain a priority value for the method. Alternatively, a device 538 is a computer-readable medium that may be used 

priority function may involve using the invocation count for to store programs including computer code, data, and the 

methods with shorter estimated compilation times and using like. Typically, mass memory device 538 is a storage 

the invocation count divided by a constant for methods with medium such as a hard disk or a tape which is generaUy 
longer estimated compilation times. 55 slower than primary storage devices 534, 536. Mass memory 

Referring next to FIG. 4, the steps associated with iden- storage device 938 may take the form of a magnetic or paper 

tifying the method with the highest priority value, i.e., step tape reader or some other well-known device. It will be 
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appreciated that the information retained within the mass 
memory device 538, may, in appropriate cases, be incorpo- 
rated in standard fashion as part of RAM 536 as virtual 
memory. A specific primary storage device 534 such as a 
CD-ROM may also pass data uni-directionally to the CPU 
532. 

CPU 532 is also coupled to one or more input/output 
devices 540 that may include, but are not limited to, devices 
such as video monitors, track balls, mice, keyboards, 
microphones, touch-sensitive displays, transducer card 
readers, magnetic or paper tape readers, tablets, styluses, 
voice or handwriting recognizers, or other wellknown input 
devices such as, of course, other computers. Finally, CPU 
532 optionally may be coupled to a computer or telecom- 
munications network, e.g., a local area network, an internet 
network or an intranet network, using a network connection 
as shown generally at 512. With such a network connection, 
it is contemplated that the CPU 532 might receive informa- 
tion from the network, or might output information to the 
network in the course of performing the above-described 
method steps. Such information, which is often represented 
as a sequence of instructions to be executed using CPU 532, 
may be received from and outputted to the network, for 
example, in the form of a computer data signal embodied in 
a carrier wave. The above-described devices and materials 
will be familiar to those of skill in the computer hardware 
and software arts. 

As previously mentioned, a virtual machine may execute 
on computer system 530. FIG. 6 is a diagrammatic repre- 
sentation of a virtual machine which is supported by com- 
puter system 530 of FIG. 5, and is suitable for implementing 
the present invention. When a computer program, e.g,, a 
computer program written in the Java™ programming lan- 
guage developed by Sun Microsystems of Mountain View, 
Calif., is executed, source code 610 is provided to a compiler 
620 within a compile-time environment 605, Compiler 620 
translates source code 610 into byte codes 630. In general, 
source code 610 is translated into byte codes 630 at the time 
source code 610 is created by a software developer. 

Byte codes 630 may generally be reproduced, 
downloaded, or otherwise distributed through a network, 
e.g., network 512 of FIG. 5, or stored on a storage device 
such as primary storage 534 of FIG. 5. In the described 
embodiment, byte codes 630 are platform independent. That 
is, byte codes 630 may be executed on substantially any 
computer system that is running a suitable virtual machine 
640. By way of example, in a Java™ environment, byte 
codes 630 may be executed on a computer system that is 
running a Java™ virtual machine. 

Byte codes 630 are provided to a runtime environment 
635 which includes virtual machine 640. Runtime environ- 
ment 635 may generally be executed using a processor such 
as CPU 532 of FIG. 5. Virtual machine 640 includes a 
compiler 642, an interpreter 644, and a runtime system 646. 
Byte codes 630 may generally be provided either to com- 
piler 642 or interpreter 644. 

When byte codes 630 are provided to compiler 642, 
methods contained in byte codes 630 are compiled into 
machine instructions, as described above. On the other hand, 
when byte codes 630 are provided to interpreter 644, byte 
codes 630 are read into interpreter 644 one byte code at a 
time. Interpreter 644 then performs the operation defined by 
each byte code as each byte code is read into interpreter 644. 
In general, interpreter 644 processes byte codes 630 and 
performs operations associated with byte codes 630 sub- 
stantially continuously. 
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When a method is called from an operating system 660, 
if it is determined that the method is to be invoked as an 
interpreted method, runtime system 646 may obtain the 
method from interpreter 644, If, on the other hand, it is 

5 determined that the method is to be invoked as a compiled 
method, runtime system 646 activates compiler 642. Com- 
piler 642 then generates machine instructions from byte 
codes 630, and executes the machine-language instructions. 
In general, the machine -language instructions are discarded 

10 when virtual machine 640 terminates. The operation of 
virtual machines or, more particularly, Java™ virtual 
machines, is described in more detail in The Java™ Virtual 
Machine Specification by Tim Lindholm and Frank Yellin 
(ISBN 0-201 -63452-X), which is incorporated herein by 

35 reference in its entirety. 

Although only a few embodiments of the present inven- 
tion have been described, it should be understood that the 
present invention may be embodied in many other specific 
forms without departing from the spirit or the scope of the 

20 invention. By way of example, steps involved with perform- 
ing a compilation during an idle period may be reordered, 
removed or added. In general, steps involved with the 
methods of the present invention may be reordered, 
removed, or added without departing from the spirit or the 

25 scope of the present invention. 

A highest priority method for compilation has been 
described as being selected out of substantially all methods 
in an execution list and a database list. Searching all 
methods in an execution list or a database list, or both, to 
locate the method with the highest compilation priority may 
prove to be expensive in the event that the execution list is 
extensive. Therefore, in one embodiment, a subset of the 
execution list may be searched, in lieu of substantially the 
entire execution list, to identify a highest priority method for 
compilation may. By way of example, the first "N" candidate 
methods from the execution list may be searched to identify 
the highest priority method in the first N candidate methods. 

As previously mentioned, a compilation priorities of 
methods may be identified, at least in part, using the invo- 
cation counters. The invocation counters are generally 
counters which are incremented each time a method is 
accessed. It should be appreciated that in some 
embodiments, invocation counters may be decayed over 
time. For example, if a method was repeatedly invoked and 
slated for compilation at the beginning of program 
execution, but is never again invoked, the invocation counter 
may be decayed to reduce the compilation priority of the 
method. Once the invocation counter for a method has been 
decayed, e.g., exponentially decayed, compiling the method 
may no longer be advisable. As such, such methods may be 
periodically removed from the execution list. 

Similarly, during the course of performing compilations, 
a determination is made regarding whether a method which 

55 is slated for compilation has previously been compiled. 
Alternatively, methods which have already been compiled 
may be removed as appropriate from either or both the 
execution list and the database list. In general, the overhead 
associated with checking the execution list and the database 

50 list for compiled methods may be relatively significant. 
However, compiled methods may be periodically removed, 
as for example at the beginning of an idle period, without 
departing from the spirit or the scope of the present inven- 
tion. 

65 Although an execution list has generally been described 
as being a list, or queue, of interpreted methods which are to 
be compiled, the execution list may also include compiled 



03/22/2004, EAST Version: 1.4.1 



5,970,249 



13 



14 



methods which are delayed from being re -compiled until 
there is an idle period. For example, in a system with two 
levels of compilers, once a method is compiled, if that 
method is repeatedly executed, it may prove to be desirable 
for the method to be re-compiled more eflBciently. In such a 
system, the methods slated for re-compilations, or secondary 
compilations, may be included in the same execution list as 
interpreted methods which are slated for compilation. 
However, the methods slated for re-compilations may, on the 
other hand, be included in a separate execution list. 

In one embodiment, the execution list may generally be a 
work list which includes delayed tasks, in addition to, or in 
lieu of, pending compilations. Such tasks may be prioritized. 
It should be appreciated that when a task from the work list 
is running, if an interrupt is received, the task may be 
allowed to be completed. By way of example, if the task 
involves garbage collection, suspending a garbage collection 
process and "backing out" of the garbage collection process 
may be as costly, if not more costly, than completing the 
process. As such, the garbage collection may be allowed to 
be completed. Tasks may also generally be suspended when 
an interrupt is received. Therefore, the present examples are 
to be considered as illustrative and not restrictive, and the 
invention is not to be limited to the details given herein, but 
may be modified within the scope of the appended claims 
along with their full scope of equivalents. 

What is claimed is: 

1. A computer- implemented method for dynamically 
compiling methods during an idle period in the processing of 
an executable computer program, the computer- 
implemented method comprising: 

identifying the idle period; 

identifying a first method selected from a plurahty of 
methods during the idle period, the first method being 
suitable for compilation, the plurality of methods being 
included in the executable computer program, wherein 
the executable computer program includes both inter- 
preted code and compiled code; and 

initializing a compilation of the first method, wherein the 
initialization of the compilation of the first method 
occurs during the idle period. 

2. A computer-implemented method as recited in claim 1 
wherein the plurality of methods is referenced in a first list 
associated with the executable computer program and the 
first method is a highest priority method for compilation 
associated with the first list. 

3. A computer-implemented method as recited in claim 1 
wherein a first set of methods selected from the plurality of 
methods is associated with a first list and a second set of 
methods selected from the plurality of methods is associated 
with a second list, the first list being created during the 
processing of the executable computer program the second 
list being created before the processing of the executable 
computer program, wherein identifying the first method 
includes: 

selecting the first method as a highest priority method 
from the first list. 

4. A computer- implemented method as recited in claim 1 
wherein a first set of methods selected from the plurality of 
methods is associated with a first list and a second set of 
methods selected from the plurality of methods is associated 
with a second list, the first list being created during the 
processing of the executable computer program the second 
list being created before the processing of the executable 
computer program, wherein identifying the first method 
includes: 
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selecting the first method as a highest priority method 
from the second list. 

5. A computer- implemented method as recited in claim 1 
fiirlher including: 

determining whether an interrupt is received by the 

executable computer program after the initialization of 

the compilation of the first method; 
continuing the compilation of the first method for a 

predetermined period of time when it is determined that 

an interrupt has been received; 
determining whether the compilation of the first method is 

completed after the predetermined period of time; and 
aborting the compilation of the first method when it is 

determined that the compilation of the first method is 

not completed after the predetermined period of time. 

6. A computer- implemented method as recited in claim 1 
wherein the idle period is identified during run -time execu- 
tion of the executable computer program, and the compila- 
tion of the first method is initiated during the idle period 
during the run-time execution of the executable computer 
program. 

7. A computer- implemented method for dynamically 
compiling methods during a period of low activity in the 
overall processing of a computer program, the computer- 
implemented method comprising: 

identifying the period of low activity; 

identifying a first method selected from a plurality of 
methods during the period of low activity, the plurality 
of methods being included in the computer program, 
the first method being suitable for compilation; 

determining whether the first method is compiled, 
wherein the determination of whether the first method 
is compiled is made during the period of low activity; 
and 

initializing a compilation of the first method during the 
period of low activity when it is determined that the 
first method is not compiled. 

8. A computer- implemented method as recited in claim 7 
further including: 

identifying a second method selected from the plurality of 
methods during the period of low activity when it is 
determined that the first method is compiled; 

determining whether the second method is compiled, 
wherein the determination of whether the second 
method is compiled occurs during the period of low 
activity; and 

initializing a compilation of the second method during the 
period of low activity when it is determined that the 
second method is not compiled. 

9. A computer- implemented method as recited in claim 7 
further including: 

determining a priority value for each of the plurality of 
methods, wherein the first method is identified based on 
the priority value for the first method. 

10. A computer-implemented method as recited in claim 
9 wherein determining the priority value for each of the 
plurality of methods includes processing an invocation 
counter associated with each of the plurality of methods 
during the period of low activity. 

11. A computer-implemented method as recited in claim 9 
wherein determining the priority value for each of the 
plurality of methods includes estimating a compilation time 
for each of the plurality of methods during the period of low 
activity. 

12. A computer-implemented method as recited in claim 
7 wherein a first set of methods selected from the plurality 
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of methods is associated with a first list and a second set of 
methods selected from the plurality of methods is associated 
with a second list, the first list being created during the 
processing of the computer program the second list being 
created before the processing of the computer program, 
wherein identifying the first method includes: 
selecting the first method as a highest priority method 
from the first list. 

13. A computer-implemented method as recited in claim 
7 further including: 

determining whether a interrupt is received by the com- 
puter program after the initialization of the compilation 
of the first method; 

continuing the compilation of the first method for a 
predetermined period of time when it is determined that 
an interrupt has been received; 

determining whether the compilation of the first method is 
completed after the predetermined period of time; and 

aborting the compilation of the first method when it is 
determined that the compilation of the first method is 
not completed after the predetermined period of time. 

14. A computer- implemented method as recited in claim 
13 further including: 

completing the compilation of the first method when it is 

determined that an intermpt has not been received; 
identifying a second method selected from a plurality of 

methods during the period of low activity; 
determining whether the second method is compiled 

during the period of low activity; and 
initializing a compilation of the second method during the 

period of low activity when it is determined that the 

second method is not compiled. 

15. A computer-implemented method as recited in claim 
7 wherein the period of low activity is identified during 
run-time execution of the computer program, and the com- 
pilation of the first method is initiated during the period of 
low activity during the run-time execution of the computer 
program. 

16. A computer-implemented method for dynamically 
processing delayed tasks during an idle period in the pro- 
cessing of a computer program, the computer-implemented 
method comprising: 

identifying the idle period in the processing of the com- 
puter program; 

identifying a first task selected from a plurality of tasks 
during the idle period in the processing of the computer 
program, the plurality of tasks being included in the 
computer program, wherein the computer program 
includes both interpreted code and compiled code; and 

starting the first task, wherein the starting of the first task 
occurs during the idle period. 

17. A computer- implemented method as recited in claim 
16 further including completing the first task when an 
interrupt is received, 

18. A computer- implemented method as recited in claim 
16 further including suspending the first task when an 
interrupt is received, 

19. A computer system for dynamically compiling byte- 
coded methods during a period of low activity during the 
execution of a computer program, the methods being asso- 
ciated with the computer program, the computer system 
comprising: 

a mechanism for identifying the period of low activity 
during the execution of the computer program; 

a mechanism for identifying a first method selected from 
a plurality of methods during the period of low activity. 
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wherein identifying the first method includes identify- 
ing whether the first method is suitable for compilation; 
and 

a compiler for initializing a compilation of the first 
5 method during the period of low activity, 

20. A computer system as recited in claim 19 further 
including: 

a first list arranged to reference a first set of the plurality 
of methods, wherein the first list is associated with the 
computer program and the first method is a highest 
priority method associated with the first list. 

21. A computer system as recited in claim 20 further 
including: 

a second list arranged to reference a second set of the 
plurality of methods, wherein the second list is created 
before the processing of the computer program and the 
first list is created during the processing of the com- 
puter program. 

22. A computer system as recited in claim 19 further 
including: 

an interrupt processor arranged to receive an interrupt 
signal during the compilation of the first method, the 
interrupt processor being in communication with the 

25 compiler, wherein the compiler is further arranged to 
continue the compilation of the first method for a 
predetermined period of time in response to a signal 
from the interrupt processor; and 
an aborting mechanism, the aborting mechanism being in 

30 communication with the compiler, wherein the aborting 
mechanism is arranged to abort the compilation of the 
first method. 

23. A computer system as recited in claim 19 further 
including: 

^5 a diagnostic mechanism, the diagnostic mechanism being 
arranged to identify when the first method is compiled. 

24. A computer-readable medium including computer 
program code devices arranged to dynamically compile 
methods during an idle period in the processing of a com- 
puter program, the computer- readable medium comprising: 

computer program code devices that identify the idle 
period; 

computer program code devices that identify a first 
method selected from a plurality of methods during the 
idle period, the plurality of methods being included in 
the computer program, the first method being suitable 
for compilation; and 

computer program code devices that initialize a compi- 
50 lation of the first method during the idle period, 

25. A computer-readable medium as recited in claim 24 
wherein the computer program code devices are embodied 
in a carrier wave, 

26. A computer-readable medium as recited in claim 24 
55 wherein a first set of methods selected from the plurality of 

methods is associated with a first list and a second set of 
methods selected ft-om the plurality of methods is associated 
with a second list, the first list being created during the 
processing of the computer program the second list being 

50 created before the processing of the computer program, 
wherein computer program code devices that identify the 
first method include: 
computer program code devices that select the first 
method as a highest priority method from the first list. 

65 27. A computer-readable medium as recited in claim 24 
wherein a first set of methods selected from the plurality of 
methods is associated with a first list and a second set of 
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methods selected from the plurality of methods is associated 
with a second list, the first list being created during the 
processing of the computer program the second list being 
created before the processing of the computer program, 
wherein computer program code devices that identify the 
first method include: 
computer program code devices that select the first 
method as a highest priority method from the fiisl list. 
28. A computer- readable medium as recited in claim 24 
further including: 
computer program code devices that determine whether 
an interrupt Ls received by the computer program after 
the initialization of the compilation of the first method; 
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computer program code devices that continue the compi- 
lation of the first method for a predetermined period of 
lime when it is determined that an interrupt has been 
received; 

computer program code devices that determine whether 
the compilation of the first method is completed after 
the predetermined period of time; and 

computer program code devices that abort the compilation 
of the first method when it is determined that the 
compilation of the first method is not completed after 
the predetermined period of time. 
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